Effective test metrics for test strategy evolution
نویسندگان
چکیده
How to measure a test process is a required competence for an effective software test manager. Effective test process measurement is useful for designing and evaluating a cost-effective test strategy. Although existing research has addressed many metrics for those purposes, most metrics are used independently. This paper summarizes a test process measurement project of the IBM Electronic Commerce Development (ECD) test teams, and analyzes the effectiveness of a set of complementary metrics for cost, time, and quality to measure the quality of test process based on the results of the project. Further discussions about implementation problems, test wisdom learned in the project, and costeffectiveness of the measurement activities and metrics are presented.
منابع مشابه
Semi-Supervised Deep Metrics for Image Registration
Deep metrics have been shown effective as similarity measures in multi-modal image registration; however, the metrics are currently constructed from aligned image pairs in the training data. In this paper, we propose a strategy for learning such metrics from roughly aligned training data. Symmetrizing the data corrects bias in the metric that results from misalignment in the data (at the expens...
متن کاملAn Evolution Strategy with Probabilistic Mutation for Multi-Objective Optimisation
Evolutionary algorithms have been applied with great success to the difficult field of multi-objective optimisation. Nevertheless, the need for improvements in this field is still strong. We present a new evolutionary algorithm, ESP (the Evolution Strategy with Probabilistic mutation). ESP extends traditional evolution strategies in two principal ways: it applies mutation probabilistically in a...
متن کاملAre concurrency coverage metrics effective for testing: a comprehensive empirical investigation
Testing multithreaded programs is inherently challenging, as programs can exhibit numerous thread interactions. To help engineers test these programs cost-effectively, researchers have proposed concurrency coverage metrics. These metrics are intended to be used as predictors for testing effectiveness and provide targets for test generation. The effectiveness of these metrics, however, remains l...
متن کاملImproved Strategies of Multi-objective Differential Evolution (MODE) for Multi-objective Optimization
Multi-objective optimization using an evolutionary computation technique is used extensively for solving conflicting multi-objective optimization problems. In this work, an improved strategy of multi-objective differential evolution (MODE) where the mutation strategy is changed to a trigonometric mutation approach is proposed. The proposed strategy along with other well known strategies of MODE...
متن کاملA Complexity Based Regression Test Selection Strategy
Software is unequivocally the foremost and indispensable entity in this technologically driven world. Therefore quality assurance, and in particular, software testing is a crucial step in the software development cycle. This paper presents an effective test selection strategy that uses a Spectrum of Complexity Metrics (SCM). Our aim in this paper is to increase the efficiency of the testing pro...
متن کامل